Key Frame Mechanism For Efficient Conformer Based End-to-end Speech Recognition

Recently, Conformer as a backbone network for end-to-end automatic speech recognition achieved state-of-the-art performance. The Conformer block leverages a self-attention mechanism to capture global information, along with a convolutional neural network to capture local information, resulting in improved performance. However, the Conformer-based model encounters an issue with the self-attention mechanism, as computational complexity grows quadratically with the length of the input sequence. Inspired by previous Connectionist Temporal Classification (CTC) guided blank skipping during decoding, we introduce intermediate CTC outputs as guidance into the downsampling procedure of the Conformer encoder. We define the frame with non-blank output as key frame. Specifically, we introduce the key frame-based self-attention (KFSA) mechanism, a novel method to reduce the computation of the self-attention mechanism using key frames. The structure of our proposed approach comprises two encoders. Following the initial encoder, we introduce an intermediate CTC loss function to compute the label frame, enabling us to extract the key frames and blank frames for KFSA. Furthermore, we introduce the key frame-based downsampling (KFDS) mechanism to operate on high-dimensional acoustic features directly and drop the frames corresponding to blank labels, which results in new acoustic feature sequences as input to the second encoder. By using the proposed method, which achieves comparable or higher performance than vanilla Conformer and other similar work such as Efficient Conformer. Meantime, our proposed method can discard more than 60\% useless frames during model training and inference, which will accelerate the inference speed significantly. This work code is available in {https://github.com/scufan1990/Key-Frame-Mechanism-For-Efficient-Conformer}Comment: This manuscript has been accepted by IEEE Signal Processing Letters for publicatio

Neuroprotection of Catalpol for Experimental Acute Focal Ischemic Stroke: Preclinical Evidence and Possible Mechanisms of Antioxidation, Anti-Inflammation, and Antiapoptosis

Neuroprotection is defined as using a therapy that affects the brain tissue in the still-viable ischemic penumbra to salvage or delay the infarction. Catalpol, the main active principle of the root of Radix Rehmanniae, was reported to have pleiotropic neuroprotective effects in neurodegenerative diseases including ischemic stroke. Here, we evaluated the neuroprotective effects of catalpol in experimental acute ischemic stroke. Studies on catalpol in animal models of acute ischemic stroke were identified from 6 databases. Twenty-five studies involving 805 animals were included. Twelve comparisons showed significant effects of catalpol on decreasing infarct size according to 2,3,5-triphenyltetrazolium chloride staining compared with the control (P<0.05). One study reported significant effect of catalpol on reducing infarct size according to magnetic resonance imaging scan compared with the control (P<0.05). Meta-analysis of these studies indicated that catalpol significantly improved the neurological function score according to Zea Longa score, Bederson score, balance beam-walking test, adhesive removal test, bar-grasping score, and corner test compared with the control (P<0.05). In conclusion, catalpol exerted neuroprotective effects for experimental acute focal ischemic stroke, largely through reducing oxidative reactions, inhibiting apoptosis, and repressing inflammatory reactions and autophagy. However, these apparently positive findings should be interpreted with caution because of the methodological flaws

An integrated approach for remanufacturing job shop scheduling with routing alternatives.

Remanufacturing is a practice of growing importance due to increasing environmental awareness and regulations. However, the stochastic natures inherent in the remanufacturing processes complicate its scheduling. This paper undertakes the challenge and presents a remanufacturing job shop scheduling approach by integrating alternative routing assignment and machine resource dispatching. A colored timed Petri net is introduced to model the dynamics of remanufacturing process, such as various process routings, uncertain operation times for cores, and machine resource conflicts. With the color attributes in Petri nets, two types of decision points, recovery routing selection and resource dispatching, are introduced and linked with places in CTPN model. With time attributes in Petri nets, the temporal aspect of recovery operations for cores as well as the evolution dynamics in cores\u27 operational stages is mathematically analyzed. A hybrid meta-heuristic algorithm embedded scheduling strategy over CTPN is proposed to search for the optimal recovery routings for worn cores and their recovery operation sequences on workstations, in minimizing the total production cost. The approach is demonstrated through the remanufacturing of used machine tool and its effectiveness is compared against another two cases: baseline case with fixed recovery process routings and case 2 using standard SA/MST

Wind and Wave Disturbances Compensation to Floating Offshore Wind Turbine Using Improved Individual Pitch Control Based on Fuzzy Control Strategy

Due to the rich and high quality of offshore wind resources, floating offshore wind turbine (FOWT) arouses the attentions of many researchers. But on a floating platform, the wave and wind induced loads can significantly affect power regulation and vibration of the structure. Therefore, reducing these loads becomes a challenging part of the design of the floating system. To better alleviate these fatigue loads, a control system making compensations to these disturbances is proposed. In this paper an individual pitch control (IPC) system integrated with disturbance accommodating control (DAC) and model prediction control (MPC) through fuzzy control is developed to alleviate the fatigue loads. DAC is mainly used to mitigate the effects of wind disturbance and MPC counteracts the effects of wave on the structure. The new individual pitch controller is tested on the NREL offshore 5 MW wind turbine mounted on a barge with a spread-mooring system, running in FAST, operating above-rated condition. Compared to the original baseline collective pitch control (CPC) (Jonkman et al., 2007), the IPC system shows a better performance in reducing fatigue loads and is robust to complex wind and wave disturbances as well

(1S*,2R*,4aS*,6aS*,6bR*,10S*,12aR*,14aS*)-10-Hydr­oxy-1,2,6a,6b,9,9,12a-hepta­methyl­perhydro­picene-4a,14a-carbolactone

The title compound, C30H48O3, was extracted from the plant Dracocephalum rupestre Hance. The mol­ecule contains five fused cyclo­hexane rings and one five-membered lactone ring. Inter­molecular O—H⋯O hydrogen bonds between the hydroxyl and carbonyl groups link the mol­ecules into chains along [010]. The absolute structure has not been determined

One-stage coclear implantation via a facial recess approach in children with otitis media with effusion

AbstractObjectiveTo investigate surgical indications, operative techniques, complications and auditory and speech rehabilitation for cochlear implant (CI) in children with otitis media with effusion (OME).Material and methodsThis is a retrospective review of records of 24children with bilateral profound sensorineural hearing loss and OME who were implanted during January 2011 to November 2014 in the Department of Otorhinolaryngology and Head and Neck Surgery at the PLA Hospital, using one-stage implantation via the facial recess approach and round window insertion. The incus was removed in 8 cases during the implantation procedure. Local infiltration of dexamethasone and adrenaline in the middle ear was also performed. Postoperative complications were examined. Preoperative and postoperative questionnaires including Categories of Auditory Performance (CAP), Speech Intelligibility Rating (SIR), and the Meaningful Auditory Integration Scale (MAIS) were collected.ResultsAll electrodes were implanted successfully without any immediate or delayed complications. Inflammatory changes of middle ear mucosa with effusion were noted in all implanted ears. The scores of post-implant CAP and SIR increased significantly in all 24 cases (t = −25.95 and −14.09, respectively for CAP and SIR, p < 0.05).ConclusionsOne-stage CI via the facial recess approach with round window insertion is safe and effective in cochlear implant candidates with OME, as seen in the 24 children in our study who achieved improved auditory performance and speech intelligibility after CI

The immunomodulatory functions and molecular mechanism of a new bursal heptapeptide (BP7) in immune responses and immature B cells

International audienceAbstractThe bursa of Fabricius (BF) is the acknowledged central humoural immune organ unique to birds and plays a vital role in B lymphocyte development. In addition, the unique molecular immune features of bursal-derived biological peptides involved in B cell development are rarely reported. In this paper, a novel bursal heptapeptide (BP7) with the sequence GGCDGAA was isolated from the BF and was shown to enhance the monoclonal antibody production of a hybridoma. A mouse immunization experiment showed that mice immunized with an AIV antigen and BP7 produced strong antibody responses and cell-mediated immune responses. Additionally, BP7 stimulated increased mRNA levels of sIgM in immature mouse WEHI-231 B cells. Gene microarray results confirmed that BP7 regulated 2465 differentially expressed genes in BP7-treated WEHI-231 cells and induced 13 signalling pathways and various immune-related functional processes. Furthermore, we found that BP7 stimulated WEHI-231 cell autophagy and AMPK-ULK1 phosphorylation and regulated Bcl-2 protein expression. Finally, chicken immunization showed that BP7 enhanced the potential antibody and cytokine responses to the AIV antigen. These results suggested that BP7 might be an active biological factor that functions as a potential immunopotentiator, which provided some novel insights into the molecular mechanisms of the effects of bursal peptides on immune functions and B cell differentiation